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Control  of  a  robotic  manipulator  is  subject  to  control  and  sensing  errors.  This  is  par¬ 
ticularly  troublesome  in  fme  motion  planning.  A  number  of  approaches  have  been 
taken  including  propagation  of  numeric  or  symbolic  uncertainties  and  the  generation 
of  plans  which  use  compliant  motion  to  achieve  goals  in  spite  of  uncertainties.  These 
approaches  have  generally  sought  to  guarantee  success  and  thus  plan  generation 
costs  are  high.  We  present  a  unique  approach  to  incrementally  acquiring  uncer¬ 
tainty-tolerance  in  robotic  manipulation  plans  through  experience.  During  plan  con¬ 
struction  and  execution,  no  reasoning  about  uncertainty  takes  place.  Consequently, 
plan  generation  and  execution  is  very  fast.  However,  in  response  to  failures,  plans 
are  refined  to  increase  their  uncertainty-tolerance  so  as  to  reduce  the  future  possibil¬ 
ity  of  the  encountered  failure.  The  incremental  refinement  approach  has  several  ad¬ 
vantages  over  guaranteed  plans.  First,  resulting  plans  are  general  and  have  explicit 
applicability  conditions.  Second,  plans  achieve  a  savings  because  they  do  not  explic¬ 
itly  consider  uncertainties.  Third,  savings  is  obtained  over  the  guaranteed  case  since 
often  only  a  subset  of  all  uncertainties  lead  to  failures  in  practice.  Last,  unguaranteed 
but  practical  plans  can  be  generated  by  the  incremental  approach  when  they  lie  out¬ 
side  the  scope  of  the  guaranteed  planner.  To  demonstrate  our  approach  we  describe 
an  implemented  system  called  GRASPER  which  learns  to  grasp  novel  objects  given 
only  imprecise  television  camera  input.  No  prior  model  of  the  objects  is  assumed, 
nor  are  the  objects  required  to  satisfy  a  priori  constraints  on  their  shapes.  Robustness 
of  the  system’s  grasping  improves  with  experience. 


This  research  was  supported  by  the  Office  of  Naval  Research  under  grant  ONR  NOOO 14-86-K-0309. 


1  Introduction 

Dealing  with  uncertainty  is  an  important  problem  in  robotic  planning.  In  executing 
a  plan  on  a  manipulator  both  control  and  sensing  errors  occur  in  addition  to  errors 
in  modelling  the  environment  Although  one  could  invest  in  mechanically  better  ro¬ 
bots  and  higher  resolution  sensors,  the  incremental  improvement  diminishes  as  the 
cost  escalates. 

Problems  with  uncertainties  are  particularly  pronounced  in  fine  motion  planning 
where  small  discrepancies  in  manipulator  control  or  piece  modelling  can  easily  re¬ 
sult  in  failures.  Some  of  the  first  approaches  to  this  problem  involved  the  propagation 
of  error  estimates  throughout  the  steps  of  a  task  numerically  [Lozano-Perez76,  Tay- 
lor76]  and  symbolically  [Brooks82].  The  error  estimate  could  be  used  to  make  deci¬ 
sions  about  what  strategy  to  apply  at  different  stages  of  the  plan.  Later,  approaches 
were  introduced  using  preimages  in  configuration  space  [Erdmann84,  Erdmann86, 
Lozano-Perez84].  A  preimage  of  a  goal  gives  a  set  of  configurations  from  which 
compliant  motion  can  be  initiated  and  guaranteed  to  succeed  despite  control  and 
sensing  uncertainties.  Where  the  previous  systems  sought  guaranteed  plans  for  goal 
achievement  under  specified  uncertainty  bounds,  Donald’s  EDR  system  relaxes  this 
requirement  permitting  execution  of  unguaranteed  plans  which  fail  in  recognizable 
ways  and  constructing  plans  which  succeed  in  spite  of  model  error  [Donald90]. 
When  a  fine  motion  plan  has  been  constructed  that  takes  advantage  of  compliant  mo¬ 
tion,  results  can  be  very  good.  For  instance,  experimental  results  obtained  by 
Gottschlich  and  Kak  in  parts  mating  operations  under  uncertainty  are  encouraging 
[Gottschlich89].  Unfortunately,  systems  which  represent  and  reason  about  uncer¬ 
tainties  explicitly  to  construct  guaranteed  plans  or  to  guarantee  that  only  recogniz¬ 
able  failure  states  occur,  incur  a  high  performance  penalty  in  planning.  For  example. 
Canny  shows  that  to  construct  an  r-step  motion  plan  under  uncertainty  in  an  m-di- 
mensional  configuration  space  with  n  polynomial  constraints  defining  the  bounds  of 
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obstacles  in  the  space  takes  an  algorithm  of  complexity  2^^^^  ”  [Canny89].*  Re¬ 
sults  like  these  have  triggered  much  interest  in  reducing  the  complexity  of  such  plan¬ 
ning  by  approximating  the  real  problem  by  simpler  but  still  realistic  ones. 

A  number  of  techniques  have  been  introduced  for  improving  the  complexity  of  robot 
planning.  These  include  slicing  configuration  space  (forbidding  motion  along  cer¬ 
tain  dimensions)  and  simplifying  the  shapes  of  objects  [Latombe90].  Generally, 
these  techniques  are  conservative  such  that  if  the  planner  succeeds  with  the  simpli¬ 
fied  model  it  is  guaranteed  to  succeed  with  the  real  problem.  Unfortunately,  this  rules 
out  many  situations  where  fine  control  is  necessary  with  cluttered  spaces  in  the  pres¬ 
ence  of  uncertainty.  A  general  robot  manipulation  system  should  be  able  to  take  ad¬ 
vantage  of  different  simplifications  in  different  situations.  For  instance,  approximat¬ 
ing  the  robot  gripper  with  a  large  rectangular  prism  might  only  be  indicated  when  the 
spacing  between  objects  exceeds  some  threshold. 

Another  approach  explored  recently  involves  open-loop  planning.  If  methods  can 
be  found  to  predict  how  actions  behave  under  uncertainty,  less  sensing  is  required. 
The  need  to  make  decisions  based  on  sensor  readings  at  execution  time  is  a  signifi¬ 
cant  source  of  complexity  (Canny89].  Mason  gives  a  detailed  analysis  of  pushing 
and  grasping  techniques  which  lead  to  success  in  the  presence  of  uncertainty  without 
requiring  sensing  [Mason85,  Mason86]. 

Yet  another  approach  to  improving  robot  planning  efficiency  is  via  machine  learning. 
Segre  explores  the  use  of  explanation-based  learning  (EBL)  [DeJong86, 
Mitchell86]  for  automatic  synthesis  of  manipulation  plans  [Segre85,  Segre88].  Be¬ 
cause  inference  rules  and  operators  are  used  to  construct  a  proof  of  why  the  plan 
should  succeed,  a  set  of  generalized  conditions  can  be  produced  which  describe  the 
applicability  of  the  plan.  Consequently,  the  plan  can  be  saved  and  used  later  for  simi¬ 
lar  tasks.  Segre 's  ARMs  system  demonstrated  the  viability  of  the  approach  for  leam- 

1 .  Canny  jxiints  out  that  this  extreme  complexity  is  due  to  the  need  to  use  sensor  readings  to  make 
decisions  at  execution  time.  A  sensorle.ss  plan  could  be  nin  in  singly  exponential  time  [Canny891. 
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ing  generalized  robot  plans.  It  did  not,  however,  deal  with  the  problems  of  uncertain¬ 
ty  which  our  work  addresses. 

Simple  machine  learning  techniques  haye  been  applied  to  the  problem  of  uncertainty 
in  robotics  planning.  Dufay  and  LaTombe  employed  an  inductive  approach  which 
uses  a  production  rale  system  to  drive  execution  [Dufay84].  Multiple  traces  are  then 
combined  to  produce  the  plan.  This  can  be  viewed  as  a  system  which  uses  experience 
with  the  world  to  gain  in  efficiency,  including  inducing  loops  and  limiting  branch 
points  to  those  possibilities  observed  in  the  traces.  The  uncertainty-tolerance  of 
plans  is  limited  to  those  cases  represented  by  the  traces  but  new  cases  can  be  added 
as  generated  by  the  production  system  when  the  plan  fails.  The  generated  plans  ex¬ 
plicitly  consider  uncertainties  and  use  sensing  operations  during  execution.  Where 
Dufay  and  LaTombe ’s  approach  is  limited  to  the  set  of  operators  described  in  the  pro¬ 
duction  rales,  our  approach  can  leam  to  adjust  parameters  of  those  operators.  Their 
plans  apply  to  a  specific  task  and  context  where  our  planner  derives  general  precondi¬ 
tions  for  plan  application  during  plan  construction.  For  example,  without  these  ap¬ 
plicability  conditions  for  a  plan,  Dufay  and  LaTombe ’s  system  can  induce  loops 
which  don’t  terminate  in  certain  cases  [Dufay84]. 

Another  approach  to  learning  robot  plans  in  the  face  of  uncertainty  is  Christiansen 
and  Mason’s  approach  [Christiansen90a].  Here,  actions  are  uied  and  theireffects  ob¬ 
served  over  many  trials  compiling  a  set  of  conditional  probabilities.  This  informa¬ 
tion  can  then  be  used  in  constructing  unguaranteed  open-loop  plans  by  plotting  a 
course  of  maximum  probability  of  goal  achievement.  Variations  on  this  technique 
are  explored  in  [Christiansen90b].  This  approach  uses  no  explicit  inference  rules  or 
operators  about  the  way  the  world  behaves  but  makes  use  of  probabilities  tabulated 
over  a  large  number  of  trials.  The  world  must  be  discretized  into  a  relatively  small 
number  of  states  to  make  such  a  tabulation  practical.  Because  there  is  no  notion  of 
what  may  effect  these  probabilities,  in  a  slightly  different  context,  the  experiments 
would  have  to  be  performed  again. 
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In  this  paper  we  present  a  general  technique  for  introducing  uncertainty-  tolerance 
into  robot  manipulation  plans  based  on  experienced  failures  with  those  plans.  Uncer¬ 
tainties  are  only  reasoned  about  in  response  to  failures,  not  when  the  plan  is  originally 
built  and  executed.  This  makes  plan  construction  and  execution  very  fast.  A  tradeoff 
exists  between  the  cost  of  generating  robot  plans  and  the  chance  of  their  failure.  Re¬ 
finement  occurs  when  plan  operators  violate  expected  sensor  conditions  during  ex¬ 
ecution.  The  refinement  process  increases  the  uncertainty-tolerance  of  specific  por¬ 
tions  of  the  plan  so  as  to  decrease  the  likelihood  of  a  similar  failure. 

The  incremental  refinement  technique  to  planning  under  uncertainty  employs  ma¬ 
chine  learning  techniques  and  offers  several  advantages  over  guaranteed  plans: 

1 )  generality  The  technique  learns  general  manipulation  plans  from  specific 
problems.  Consequently,  planning  time  can  be  saved  if  an  applicable  plan  has  al¬ 
ready  been  generated  and  can  be  instantiated  for  the  task  at  hand.  For  instance,  a  gen¬ 
eral  plan  might  embody  a  technique  for  grasping  an  object  when  two  near-parallel 
faces  are  not  occluded  by  nearby  objects.  The  system  must,  however,  guarantee  the 
conditions  for  that  plan  hold.  One  of  these  involves  checking  that  no  nearby  objects 
occlude  the  grasping  faces.  Not  only  do  such  general  plans  save  planning  time  if  for¬ 
merly  learned  plans  can  be  applied  to  new  situations,  but  the  presence  of  general  con¬ 
ditions  for  plans  is  particularly  powerful.  Suppose  a  motion  planning  task  involves 
moving  first  through  a  relatively  sparse  part  of  the  workspace  and  then  through  a 
more  cluttered  part  of  the  workspace.  It  becomes  possible  to  derive  an  operator  se¬ 
quence  first  using  one  plan  that  is  inexpensive  and  applies  in  spar  sely  occupied 
spaces  followed  by  another  more  expensive  plan  which  applies  in  cluttered  spaces. 

2)  complexity  In  constructing  a  guaranteed  plan  under  uncertainty  all  possible 
potential  errors  and  their  intei’aciions  must  be  considered.  Given  some  distribution 
of  tasks  a  manipulator  must  perform,  not  all  those  enoi  s  and  interactions  are  likely 
to  arise.  Consequently,  an  incremental  lear  ning  approach  can  adapt  plans  to  the  level 
of  uncertainty-tolerance  iei|uired  without  expending  the  additional  effort  to  guaran¬ 
tee  success  in  unlikely  situations.  Furthermore,  uncertainty-tolerance  gets  built  into 
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the  plan  implicitly  such  that  no  explicit  reasoning  about  uncertainty  takes  place  when 
the  plan  is  constructed  and  executed,  only  when  it  is  refined. 

3)  scope  Guaranteed  planning  approaches  and  those  which  seek  to  guaran¬ 

tee  recognizable  failures  states  can  never  be  applied  when  such  guarantees  cannot 
be  proven.  The  incremental  approach  has  the  potential  to  learn  techniques  which 
succeed  in  practice  with  a  particular  set  of  tasks  but  which  can’t  be  guaranteed. 

It  is  worthwhile  to  note  that  any  incremental  approach  which  relies  on  failures  makes 
the  assumption  that  some  amount  of  failures  is  tolerable.  While  the  rate  of  failures 
tends  to  decrease  as  experience  is  gained,  one  cannot  guarantee  that  future  failures 
are  not  possible  without  constructing  a  guaranteed  plan.^  There  are  certainly  do¬ 
mains  where  guaranteed  plans  are  much  more  crucial  and  worth  the  additional  effort 
to  generate  them.  One  would  not  want  a  remote  manipulator  learning  from  failure 
in  moving  botdes  of  nitro-glycerin. 

In  the  next  sections,  we  introduce  data  approximations  which  are  explicit  representa¬ 
tions  for  uncertain  and/or  simplified  sets  of  data,  plan  parameters  which  can  be  tuned 
to  affect  uncertainty-tolerance  of  a  plan,  and  the  plan  refinement  procedure.  A  de¬ 
tailed  robotic  grasping  example  is  then  presented  from  an  implemented  system. 

2  Data  Approximations 

Data  approximations  are  representations  for  approximate  continuously  valued  data 
about  the  state  of  the  world.  They  can  either  be  external  or  internal.  External  data 
approximations  are  used  to  represent  the  uncertainty  of  data  in  the  world.  Internal 
data  approximations  are  used  to  simplify  complex  sets  of  data  to  make  planning  more 
tractable.  First,  let  us  consider  external  data  approximations. 

2.1  External  Data  Approximations 

An  external  data  approximation  involves  a  set  of  quantities  for  which  the  system  is 
given  approximate  values  typically  via  imperfect  sensors.  Let  Qe  be  a  vector 

2.  Strictly  a  guaranteed  plan  is  only  guaranteed  under  fixed  assumptions  about  the  magnitude  of 
the  uncertainties. 
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93.  of  quantity  variables.  Every  9,  exists  along  a  continuous  dimen¬ 
sion  Z)(^/)  and  has  a  measured  value  knowable  to  the  system  denoted  Mviqi) .  There 
is  also  an  actual  world  value  not  knowable  to  the  system  denoted  Ayiqi) .  For  a  sen¬ 
sor  to  yield  a  valid  approximation  we  require  that  the  conditional  probability 
P{  Mviqi)  =  a,  I  Aviqi)  -  r,  )  is  monotonic  in  |  r,  -  a,  | .  Given  the  actual  value  r, 
for  a  sensed  quantity  (Av(^/)  =  r,) ,  the  likelihood  of  measuring  value  m\  is  greater 
than  measuring  value  m2  in  just  those  cases  that  m\  is  closer  to  r/ than  is  m2.  More 
precisely: 

P(Mv(9,)  =  mi\Av(qi)  =  n)  >  P(Mv(qi)  =  m2|Av<9,)  =  n)  iff  |m,  -  r/|  <  |m2  -  /vl  (2.1) 

In  the  case  of  external  data  approximations,  the  values  {Mv{<li)  \i  =  are 

the  best  information  the  system  has  about  the  quantity  variables  .  The  only  possible 
way  to  improve  this  information  would  be  to  interact  with  the  world.  For  purposes 
of  planning  with  the  data  represented  by  the  approximations,  the  system  behaves  as 

if  QE  =  {Mv(<ii)  l,2,..,,n>.  The  qualitative  definition  of  a  data  approximation 
is  never  employed  during  planning,  only  when  analyzing  failures.  * 

2.2  Internal  Data  Approximations 

With  an  internal  data  approximation,  the  system  chooses  the  values  for  the  quantity 
variables  Qi  with  a  data  approximation  procedure.  Using  a  simplified  internal  de¬ 
scription  of  the  real  world  typically  results  in  more  efficient,  though  less  accurate, 
planning.  Internal  data  approximations  can  be  adjusted  through  the  system’s  reason¬ 
ing  alone.  By  expending  more  or  less  resources  reasoning  about  a  plan  the  system 
may  bias  its  planning  towards  accuracy  or  towards  efficiency.  The  costs  associated 
with  planning  failures,  execution  failures,  and  other  features  of  the  task  domain  may 
be  thought  of  as  specifying  a  utility  function.^  For  a  given  problem  distribution  in 
a  domain  there  is  an  optimal  faithfulness  of  representation  that  maximizes  the  sys- 

3.  For  a  model  of  the  different  aspects  of  utility  for  plan  to  be  executed  in  uncertain,  complex 
domains  see  |Bennett891. 
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tern’s  performance  according  to  the  utility  costs.  One  can  think  of  internal  data  ap¬ 
proximations  as  being  like  external  data  approximations  except  that  the  ideal  un¬ 
knowable  value  of  the  variables  represents  the  optimal  setting,  while  the  actual 
represented  value  for  a  quantity  corresponds  to  the  value  chosen  by  the  system  in  an 
attempt  to  maximize  utility. 

3  Plan  Parameters 

Plans  employ  continuous  numeric  parameters  which  can  be  mned  to  affect  uncer¬ 
tainty-tolerance.  It  is  important  that  these  parameters  depend  on  the  situation  to 
which  the  plan  is  applied  (the  plan’s  context).  A  simple  example  is  a  parameter  that 
specifies  the  height  which  a  manipulator  must  be  above  the  workspace  to  safely  navi¬ 
gate  without  collisions.  The  possible  settings  for  this  parameter  are  a  function  of  the 
highest  object  in  the  workspace.  Therefore,  it  depends  on  context.  This  means  a  gen¬ 
eralized  plan  must  choose  its  parameter  values  at  the  time  the  plan  is  applied. 

Let  Qp  be  the  set  of  plan  parameters  and  Ap  be  the  set  of  their  respective  values. 
Every  qi  €  Qp  is  defined  along  a  continuous  dimension  Diqi) .  Let  there  be  a  low 
bound  Liow(Diqi),Q  and  a  high  bound  LhighiD{qi),Q  on  the  values  which  g,  may 
assume  along  dimension  Diqi)  in  context  C.  A  is  a  partial  world  state  speci¬ 

fication.  Figure  I  gives  a  pictorial  representation  for  the  dimension  Diqi) .  The 


Q  q.  =  L,„^(D(q;),  C) 

lower  limit  plan  parameter's  current  value  upper  limit 

Figure  1.  A  Graphic  Representation  of  Dimension 
plan’s  parameter  values  Ap  are  in  general  dependent  on  context.  The  system 

chooses  Ap  based  on  a  set  of  preferences  P{qi,  C)  for  each  q,  in  context  C. 

A  preference  p  G  P{qi,C)  is  a  3-tuple  <  V/o„,(C)  ,Vhigh{Q  >  where  ViouiQ  and 
^highiC)  form  an  intei'val  dependent  on  context,  and 
/■  G  C  increasing,  decreasing,  constant }  is  a  relation  describing  the  behavior  of  a 
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quality  fxmction  FQ^i,c  in  that  interval.  The  greater  the  value  of  the  quality  function 
pQ^q.^ciX) ,  the  better  the  value  for  X  as  the  parameter  setting  in  that  context.  Addi¬ 
tionally,  a  set  of  preferences  are  consistent  if  for  the  cunent  context  their  intervals 
lie  within  the  bounds  iLu,w(D(qi),Q  <  ViowiQ  ^  Vf,igh{C)  <  Lhigh{D(qi),Q  ) 
and  no  two  overlap.  Figure  2  shows  two  consistent  preferences  and  one  possible 


P(qi,  O  =  {(V'tow.itQ,  increasing),  Vi,i,,2{0,decreasing)j 

Figure  2.  A  Graphic  Representation  Of  Two  Consistent  Preferences  and  a  Quality 
Function  which  Satisfies  Them 

quality  function  which  satisfies  them.  We  assume  limited  interactions  between  pa¬ 
rameters  in  that  the  preferences  must  maintain  their  relative  ordering  under  any  pos¬ 
sible  valuation  of  the  other  plan  parameters. 

When  a  general  plan  is  applied  in  a  specific  situation  (context),  the  cuirent  quality 
function  for  each  parameter  determines  its  value.  A  value  for  the  parameter  is  chosen 
so  as  to  maximize  its  quality  value.  The  choice  of  parameter  value  may  be  con¬ 
strained  in  a  given  context.  For  instance,  in  grasping  a  polygonal  object,  one  parame¬ 
ter  involves  the  angle  between  grasping  faces.  Since  the  object  has  only  a  discrete 
number  of  faces,  there  are  only  a  discrete  number  of  choices  for  the  parameter  value. 
The  choice  giving  the  best  quality  value  is  chosen. 

4  Refining  Failing  Plans  for  Increased  Uncertainty-Tolerance 

When  constructing  a  plan,  any  actions  to  be  canned  out  in  the  plan  must  include  a 
specification  of  .sensor  readings  expected  during  execution  of  the  action.  The  proof 
which  justifies  why  a  plan  will  succeed  (also  refen^ed  to  as  the  explanation)  in  the 
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system’s  model  of  the  world  also  justifies  the  expected  sensor  readings.  Failures  are 
thus  defined  by  expectation  violations.  These  occur  when  the  supporting  proof  for 
an  expectation  is  valid  in  the  model  but  is  contradicted  by  real-world  experience. 
That  difference  triggers  the  first  phase  of  failure  recovery:  generating  a  proof  of  how 
plan  parameters  can  be  tuned  to  reduce  the  chance  of  the  failure  in  the  future. 

In  order  to  diminish  the  chance  of  uncertainty-related  failures,  it  is  necessary  to  de¬ 
cide  which  plan  parameters  to  tune  and  how  to  tune  them.  In  our  model,  failures  can 
always  be  attributed  to  poor  data  approximations.  In  order  to  devise  a  strategy  for 
tuning  parameters  so  as  to  decrease  the  likelihood  of  a  failure,  it  is  necessary  to  reason 
about  the  relationships  which  exist  between  data  approximate  quantities,  the  failing 
expectations,  and  tunable  plan  parameters. 

We  employ  a  qualitative  model  of  the  relationship  between  continuous  quantities. 
It  is  important  to  preserve  generality  in  learning  preferences  for  parameters.  Other¬ 
wise,  we  could  not  transfer  experience  gained  about  parameter  settings  to  similar  sit¬ 
uations.  A  qualitative  model  allows  us  to  reason  about  the  important  relationships 
between  quantities  without  tieing  us  to  the  specific  values  for  the  cunent  situation. 
Let  Q+(a,  b)  signify  that  the  magnitude  of  quantity  b  positively  influences  the  mag¬ 
nitude  of  quantity  o.  Similarly,  QJa,b)  means  the  magnitude  of  quantity /.)  inverse¬ 


ly  influences  the  magnitude  of  quantity  a.  That  is,  if  a  =Jib,C],C2,  ...,c„)  themini- 

df 

mum  we  must  know  to  create  such  a  relation  (without  ambiguity)  is  the  sign  of  —  . 

db 


If  -^  >  0  then  Q+(a,b)  holds.  If  -^  <  0  then  Q_(a,b)  holds.'* 
db  db 

Quantitative  predicates  employed  by  the  system  have  one  of  two  basic  intents.  Either 
they  are  calculation  predicates,  whose  puipose  is  to  compute  some  value  (e.g.  a  pred¬ 
icate  for  subtraction),  or  they  iue  test  predicates,  which  are  designed  to  fail  for  certain 
sets  of  inputs  (e.g.  a  predicate  for  performing  a  less-than  compiu’ison).  There  is  no 


4.  Q+,  Q_.  and  the  associated  iiilercnce  rules  about  increasing  and  decreasing  (jiiantities  are 

used  as  in  qualitative  process  theory  [Forbiis84]. 
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way  to  vary  the  probability  of  success  of  a  calculation  predicate  since  they  always 
succeed.  A  test  predicate’s  probability  of  success  is  sensitive  to  the  probability  distri¬ 
bution  of  its  argument  quantities.  In  the  diagram  below,  the  less-than  test  on  the  right 

(<  a  b)?  probability  (<  a  b)? 

distributions 

,  yaVybV  ^ 

has  a  higher  probability  of  succeeding  given  the  illustrated  probability  distributions 
for  its  arguments  than  the  one  on  the  left.  While  probability  distributions  are  difficult 
to  define  and  work  with,  recall  the  simpler  qualitative  view  of  the  probability  distri¬ 
bution  defined  for  data  approximations  in  section  2.1:  probability  density  decreases 
monotonically  as  one  moves  either  higher  or  lower  away  from  the  central  value. 
Therefore,  if  we  can  tune  one  of  the  arguments  to  a  test  predicate  we  can  affect  its 
chance  of  success. 

Let  DA(q)  signify  that  ^  is  a  data  approximate  quantity.  Now  let  us  inu  oduce  the  no¬ 
tation  PQ-i-ip,  q)  to  express  that  the  magnitude  of  the  quantity  q  directly  influences 
the  magnitude  of  the  probability  of  success  of  test  predicate  p.  Similai  ly,  PQ-ip,  q) 
indicates  that  the  magnitude  of  quantity  q  negatively  influences  the  magnitude  of  the 
probability  of  success  of  test  predicate  p.  This  provides  a  mechanism  for  connecting 
the  probability  of  a  predicate  being  satisfied  with  the  magnitude  of  a  quantity.  The 
inference  rule  which  follows  is  one  of  .several  which  follow  from  our  definition  for 
data  approximations:  PQJa  <b,a)  ^  DAiq),  Q+{b,  q),  ->  Q+(b,  a).  ^ 

The  rule  states:  if  ^  is  a  data  approximate  quantity  and  hence  uncenain  and  directly 
influences  the  magnitude  of  a  quantity  b,  the  likelihood  of  a<b  succeeding  is  inverse¬ 
ly  proportional  to  the  magnitude  of  a  provided  a  does  not  directly  influence  b.^  Let 
PP(q)  indicate  that  the  quantity  q  h  a.  plan  parameter  and  hence  is  tunable.  Let 

5.  Inference  niles  here  will  be  shown  in  the  form  of  Horn  clauses  with  their  consequent  at  the  left 
and  a  list  of  the  conjunctive  antecedents  on  the  right. 

6.  This  nile  is  stronger  than  it  need  be  but  otherwi.se  rates  of  change  would  also  have  to  be  consid¬ 
ered.  We  may  relax  this  in  a  later  implementation. 
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PS|(p)  signify  that  the  probability  of  success  of  predicate/?  is  increasing.  Let  Q\{q) 

signify  that  quantity  q  is  increasing.  Therefore  we  could  use  the  following  rules  to 
increase  the  probability  of  a  predicate  p  give  than  ^  is  a  plan  parameter: 

P5|(p)  «=  PQ+(p,q),  Q^iq).  and  Q^iq)  <=  PPiq). 


The  second  rule  above  asserts  that  we  can  increase  plan  parameters  to  achieve  goals 
(because  they  .are  tunable). 

It  must  also  be  possible  to  propagate  the  qualitative  probabilities  of  predicates.  Let 
ANT(pj  ,p2 )  indicate  that  p2  is  an  antecedent  of  an  inference  rule  for  which  /?;  is  a  con¬ 
sequent.  One  sound  rule  for  propagation  of  qualitative  probabilities  across  rules  can 
then  be  expressed: 

PQ+(P\,q)  -^ANT(p],p2),PQ+(p2,q)yx[[ANT(pux)  A  .v  p2]  =*•  -‘PQ-{x,q)]  (2.2) 


The  general  rules  required  to  construct  a  qualitative  tuning  proof  fall  into  four  cate¬ 
gories: 


general  qualitative  inference  rules  —  inference  rules  necessary  to  reason  about 
increasing  and  decreasing  quantities 

Example:  Q](x)  <=  Q+{x,y),Q^{y). 


qualitative  predicate  definitions  —  rules  providing  qualitative  definitions  for  sys¬ 
tem  predicates  relating  quantities 


Example: 

Q+ix,y)  <=  [x  =  y  +  z]. 


(because 


{■^'=Ay)}  A 


approximation  definition  rules  —  rules  defining  the  behavior  of  test  predicates 
using  data-approximate  quantities 

Example:  PQ+(a  <b,b)<=  DA{q),  Q+{a,  q),  ->  Q+{a,  b). 

qualitative  probability  rules  —  rules  about  the  propagation  of  qualitative  proba¬ 
bilities  (Example:  Rule  2.2  above) 

The  qualitative  tuning  explanation  is  a  sound  proof  of  how  to  positively  influence 


the  probability  of  success  of  the  predicate  which  supported  the  failing  expectations. 


The  procedure  for  constnicting  the  tuning  proof  and  tuning  the  plan  parameters  as 
a  result  is  as  follows: 
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1)  Compute  the  set  P  of  generalized  preconditions  and  effects  for  the  plan  justifi¬ 
cation  structure^ 

2)  Take-all  generalized  variables  which  are  quantitative  arguments  to  every  predi¬ 
cate  p  E  P  as  quantity  variables  for  the  qualitative  reasoning  process. 

3)  Find  all  qualitative  influences  among  these  quantity  variables.  This  is  possible 
since,  if  two  plan  quantities  ai  e  related,  we  know  the  exact  functional  relationship 
(in  the  model). 

4)  Construct  a  proof  based  on  the  qualitative  inference  rules  discussed  above  for 
how  to  unambiguously  qualitatively  increase  the  probability  of  success  of  the 
predicate  supporting  the  expectations  to  the  failed  action. 

5)  Collect  the  set  of  quantity  increases  and  decreases  justified  by  the  fact  that  plan 
parameters  PP(q)  are  tunable.  This  amounts  to  finding  applications  of  the  rules 

^  PPiqD  and  Qiiq)  PP(q)  in  the  proof. 

6)  For  each  of  the  tunable  plan  parameters  in  the  set  collected  above,  add  a  new 
preference  to  the  set  of  preferences  for  that  parameter.  This  preference  will  speci¬ 
fy  as  one  of  it  bounds  a  general  expression  for  the  point  at  which  the  failure  oc¬ 
curred  and  as  its  relation  increasing  or  decreasing  as  given  in  step  5.  The  other 
bound  will  be  realized  in  conjunction  with  the  neighboring  preferences. 

Next,  we  introduce  a  fully  implemented  system  and  demonstrate  the  algorithm. 

5  The  GRASPER  System 

Figure  3  shows  the  laboratory  setup. 

The  cunent  implementation  of  the  ar¬ 
chitecture  is  called  GRASPER  and  is 
written  in  Common  Lisp  running  on  an 
IBM  RT125.  GRASPER  is  interfaced 
with  a  frame  grabber  connected  to  a 
camera  mounted  over  the  workspace. 

The  camera  produces  bitmaps  from 
which  object  contours  are  extracted  by  the  system.  The  system  also  controls  an  RTX 
scara-type  robotic  manipulator.  The  RTX  has  encoders  on  all  of  its  joint  motors  and 
the  capability  to  control  many  parameters  of  the  motor  conu  ollers  including  motor 
current.  This  gives  the  system  a  rudimentary  capability  of  detecting  collisions  with 

7.  This  is  accomplished  through  application  of  the  EGGS  lMooney861  or  EBG  (Milchell861  expla¬ 
nation-based  generalization  algorithms. 


Pieces 

Figure  3.  GRASPER  Experimental  Setup 
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the  RTX  gripper  *  This  type  of  sensing  gives  feedback  during  execution  of  a  plan 
when  the  camera’s  view  of  the  workspace  would  otherwise  be  obscured. 

Our  current  goal  for  the  GRASPER  system  applied  to  grasping  is  to  successfully 
grasp  the  plastic  pieces  from  puzzles  designed  for  young  children.  Since  the  pieces 
are  laminar,  an  overhead  camera  is  used  to  sense  piece  contours.  These  pieces  have 
interesting  shapes  and  are  large  enough,  yet  challenging,  to  grasp.  The  goal  is  to 
demonstrate  improving  performance  at  the  grasping  task  over  time  in  response  to 
failures.  Some  of  the  failures  the  current  implementation  learns  to  overcome,  when 
using  isolated  grasp  targets,  include  learning  to  open  wider  to  avoid  stubbing  the  fin¬ 
gers  on  an  objects,  and  learning  to  prefer  more  parallel  grasping  faces  to  prevent  un¬ 
stable  grasps.  We  are  also  exploring  grasping  in  cluttered  workspaces  where  trade¬ 
offs  exist  between  plan  parameters. 


Figure  4  shows  part  of  the  system’s  status  display  during  a  grasping  task.  First,  the 


system  uses  the  camera  to  acquiie  contour  information  about  objects  in  the  work¬ 
space,  These  contours  are  shown  on  the  left  in  the  figure.  Next,  the  contours  are  ap¬ 
proximated  with  n-gons  (internal  data  approximations)  which  result  in  (n^-n)/2  pos¬ 
sible  unique  grasping  face  pairs.  These  approximated  object  contoura  appear  on  the 
right  in  the  Figure  4.  The  algorithm  chooses  the  value  of  n  such  that  an  approxima- 

8.  A  wrist  force  sensor  would  be  more  desirable.  The  method  currently  used  involves  applying 
enough  cuirent  to  the  motor  to  overcome  friction  of  the  arm  mechanism  and  inlerpreting  non-chang¬ 
ing  joint  encoders  as  evidence  of  a  contact. 
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Light  line  segments  show 
data  appro^imaUpn  of  contour 


tion  to  the  object  is  possible  within  a  certain  error  threshold.  The  data-approximated 
object  representations  as  well  as  the  current  information  about  the  state  of  the  robot 
manipulator  are  entered  into  the  system’s  model  of  the  initial  situation.  The  target 
object  is  then  selected  and  an  explanation  is  generated  for  how  to  achieve  a  grasp  of 
the  target.  Figure  5  highlights  the  selected 
target  object.  The  light  lines  indicate  the  data 
approximation  to  the  object  contour  while 
the  heavy  outline  shows  the  actual  sensed 
object  contour  points.  The  arrows  indicate 
the  positions  of  the  leading  edges  of  the  fin¬ 
gers  for  the  grasp  position  given  by  the  pro¬ 
duced  explanation.  The  proof  tree  for 
achieving  grasp-object  involves  a  total  of  about  300  nodes  with  a  maximum  depth 
of  10  levels. 


Dark  points 
are  actual 
object  con-/ 
tour  points 


Anows  illustrate 
planned  finger 
positions 


Figure  5.  Grasp  Target  and 
Planned  Finger  Positions 


Parameters  are  implemented  by  inference  rules  which  choose  their  value  dependent 
on  the  situation  in  which  they  are  applied.  When  new  preferences  are  added  for  a 
parameter,  the  associated  rules  are  updated  so  as  to  choose  potential  maxima  of  the 
new  quality  function.  Generalized  plans  refer  to  the  consequents  of  the  rules  which 
choose  parameter  values.  In  this  case,  initially  there  were  no  preferences  for  the 
plan’s  opening  width  parameter  other  than  it  be  a  legal  value  between  the  width  of 
the  target  object  and  the  minimum  of  the  maximum  gripper  opening  and  the  distance 
to  the  nearest  object.  One  of  the  initial  rules  for  the  opening  width  parameter  is  shown 
in  Figure  6.  This  rule  penains  to  the  case  where  the  gripper  is  cunently  open  less 
than  the  minimum  opening  to  satisfy  the  surround  goal  in  the  plan.  It  then  chooses 
the  minimum  opening  which  satisfies  the  goal  because  this  is  the  closest  potential 
maxima  of  the  (initially  flat)  quality  function.  The  rule  therefore  affects  the  .separa¬ 
tion  of  the  arrows  shown  in  Figure  5.  After  the  explanation  was  generated,  and  its 
associated  operator  sequence  executed,  the  monitored  action  shown  in  Figure  7  en¬ 
counters  a  violation  of  the  expected  sen.sor  readings. 
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INTRA-RULE:  R4513  •* _ which  are  initially  defined  by 

FORM'  opening  width  rule  approximation 

(CHOSEN-OPENING- WIDTH  7GRIPPER  ?X  ?Y  7ANGLE  70BJECT  7RETURN) 
ANTS:  find  minimum  required 

(GRIPPER-OPENING  7GRIPPER  7LOP4510)  opening  so  fingers  don't  collide  with 

(GRIPPER-PERP-WIDTH  7GRIPPER  7SPAN)  ^  object  in  approximate  model 
(MIN-SPAN-FOR-OBJECT  70BJECT  7X  7Y  7ANGLE  7SPAN  7LEFT  7RIGHT) 

(SUM  7LEFT  7RIGHT  7RETURN) 

(MAX-GRIPPER-OPENING  7GR1PPER  7MAX-OPEN) 

(<=  7RETURN  7MAX-OPEN)  can’t  achieve  it  even  in  approximate  model  if  too 
!  wide  for  gripper 

(<7LOP4510  7RErURN)  .  .  .u  .  i 

PARAMETER:  CHOSEN-OPENING-WIDTH*^  pointer  to  the  parameter  this  nile  is 

associated  with 

Figure  6.  One  of  the  Initial  Parameter  Rules  For  Opening  Width 

(MONfTOR  (MOVE-ZED  7GRIPPER 199764  DOWN  5  64  20  POSITION)  move  down 

(AND  (POSITION  ZED  7ZPOS 199309)  (FORCE  ZED  7ZFOR 1993 10) 

(<  7ZFOR1993 10  30))  - ^ force  position  to  be  recorded  and  all  sensed 

(POSITION  ZED  7LEVEL19931 1)  forces  on  this  joint  must  be  less  than  30  units 
NIL7DOC199312  ? 

(NO-GRIPPER-COLMSION-OB4gCT  7GRIPPER 199764  7X 1 99501  7 Y 1 99502 
7ANGLE 199503  7^TH  199504 ?OS7ECriW756)) 

jusbfication  for  sensor  expectations  (variables 
bound  by  plan  precondiUons) 

Figure  7.  The  Failing  Monitored  Action 


/ 

temunate  when  position  is  0  (at  the  table) 


The  original  explanation  for  the  no-gripper-collision-object  goal  indicated  in  the 
above  monitored  action  is  now  suspect  due  to  the  violated  expectations.  A  sketch 
of  the  specific  explanation  is  shown  in  Figure  8.  This  explanation  for  why  no  external 
force  should  have  been  sensed  during  the  downward  move  of  the  gripper  is  the  snut- 
ing  point  for  developing  the  qualitative  tuning  explanation.  Data  approximate  quan¬ 
tities  and  tunable  parameters  employed  in  the  plan  support  proof  are  identified  and 
asserted  as  such.  A  proof  is  then  constructed  for  increasing  the  probability  of  success 
of  the  no-gripper-collision-object  goal.  Figure  9  shows  the  qualitative  explanation 
for  how  opening  the  gripper  (increasing  the  opening-width  tunable  parameter)  posi¬ 
tively  influences  the  probability  that  there  will  be  no  collision  between  the  first  grip¬ 
per  and  the  object.  The  topmost  left-hand  subtree  establishes  that  decreasing  the 
quantity  TEST492  can  positively  influence  the  probability  of  success  of  the  the  prob¬ 
ability  of  the  no-gripper-collision  predicate.  This  is  because  decreasing  the  quantity 
TEST492  can  increa.se  the  probability  of  the  predicate  (<=  TEST492  M1N490) 
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(NO-GRIPPER-COLLISION-OBJECT  GRIPPERl  289.62  267.53  -12.70  38.89  OBJECT4543 
^  (LEFT-FINGER-OF  GRIPPERl  FINGERl) 

I  WoN-INTERSECTING-GRIPPER-FINGER-OBJECT  GRIPPERl  FINGERl  289.62  267.53  -12.70  38.89 
^  OBJECT4543) 

Subproof for  translating  finger  to  appropriate  opening  width  (6  facts,  8  built-ins) 

\®  Subproof for  counter-rotating  object  center  for  clipping  against  finger  (8  built-ins) 

•  Subproof  for  calculating  extents  and  checking  for  overlap  (7  built-ins) 

» (RIGHT-FINGER-OF  GRIPPERl  FINGER2) 

^NON-INTERSECTING-GRIPPER-FINGER-OBJECT  GRIPPERl  HNGER2  289.62  267.53  -12.70  38.89 
^  OBJECT4543) 

Subproof for  translating  finger  to  appropriate  opening  width  (6  facts,  8  built-ins) 

\©  SHARED  Subproof for  counter-rotating  object  center  for  clipping  against  finger 
\  (8  built-ins) 

9  Subproof  for  calculating  extents  and  checking  for  overlap  (7  built-ins) 

Figure  8.  Explanation  Specific  to  Failure 


(PQ-/VCCTEST492) 


(DECREASE  TEST492) 


(ANTECEDENT-OF  NGC  (<- TEST492  MIN490)) 

I  Subproof  showing  that  for  all  fO- TFtTao?  WlDTHSOat 

(PQ-(<-TEST492  MIN490)TEST492)  antecedents  ANT  of  NCC  that 

(NOT  (PQ+  ANT  TEST492))  / 

(APPROX-QUANTITY  OBX5nT®*®Sas.~.-..,___  (TUNING-QUANTITY  WIDTH504  INCREASING) 
(Q+  MIN490  I 

(NOT(Q+  MIN49('TEST492)  niNARi  P  wiirrHSt 
(QRELATION  (POSITION  OBJECT505  OBX51 1  OBY512))  *  lUNABLE  WID  01504) 

(D ATA-APPROXIM ATION  (POSITION  OBJECT505  0BX5 11  OB Y5 1 2)  OBX5 1 1 ) 


j  Where  NGC  represents  the  failing  predicate:  | 

j  (NO-GRIPPER-COLLISION-OBJECT  GRIPPER499  X501  Y502  ANGLE503  WIDTH504  { 

j _ OBJJCT^Sl _ J 

Figure  9.  A  Qualitative  Tuning  Explanation 

which  is  an  antecedent  of  a  rule  supporting  the  no-gripper-coUision  predicate  and 


all  of  the  other  antecedents  to  that  rule  can  be  shown  as  non-decreasing  with  respect 
to  decreasing  TEST492.  The  probability  of  success  of  the  predicate  (<=  TEST492 


M1N490)  increases  when  TEST492  is  decreased  because  MIN490  is  influenced  by 


a  data  approximate  quantity.  The  right  subtree  of  the  proof  establishes  that  the  t|uan- 
tity  TEST492  can  be  decreased  becau.se  it  is  influenced  inversely  by  a  tunable  param- 
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eter  WIDTH504  which  can  be  increased.  The  parameter  WIDTH504  is  the  opening 
width  parameter  for  the  gripper. 

The  qualitative  tuning  explanation  indicates  that  the  chosen-opening-width  param¬ 
eter  should  be  tuned.  Namely,  that  an  increasing  preference  be  posted  at  the  mini¬ 
mum  opening  width,  which  was  chosen  in  the  failure.  Figure  10  illustrates  the  shape 

Chosen-Opening-Width  (Initial)  Chosen-Opening-Width  (After  Tuning) 

*  T  1  quality  function 

I  quality  function  I  — I 

Ml  .1  I  ^  ^  t.  a-"***^  § 

- J  widthoftargetobject  ^  c - , - j  posu^f  p«f«ence:  /  >- - 

minfdistance  to  nearest  object,  prefers  greater  min(distance  to  nearest  object, 

max-opening-widUi)  than  target  object  max-opening-width) 

Figure  10.  The  Chosen-Opening- Width  Parameter  Quality  Function  After 
Learning  New  Preference 

of  the  chosen-opening-width  parameter’s  quality  function  before  (left)  and  after 
(right)  tuning  has  occurred.  After  parameter  tuning,  the  rules  associated  with  param¬ 
eter  are  updated.  Afterwards,  the  rule  associated  with  this  parameter  reads  as  shown 
in  Figure  11.  This  rule  prefers  selection  of  the  peak  of  the  newly  re-calculated  quality 

INTRA-RULE:  R4611 
FORM: 

(CHOSEN-OPENING-WIDTH  7GRIPPER  ?X  ?Y  7ANGLE  70BJECT  7RETURN) 
ANTS: 

(GRIPPER-PERP-WIDTH  7GRIPPER  7SPAN) 

(DISTANCE-TO-CLOSEST-OBJECT  70BJECT  ?X  ?Y  7ANGLE  7SPAN  7RAD1US) 
(GRIPPER-HNGER-PARALLEL-WIDTH  7GRIPPER  7PSPAN) 

(DIF  7RADIUS  7PSPAN  7NRADIUS) 

(MAX-GRIPPER-OPENING  7GRIPPER  7MAX-OPEN) 

(MIN  7NRADIUS  7MAX-OPEN  7RETURN) 

(MIN-SPAN-FOR-OBJECT  70BJECT  7X  7Y  7 ANGLE  7SPAN  7LEFT  7RIGHT) 

(SUM  7LEFT  7RIGHT  7MIN) 

«=  7M1N  7RETURN) 

CONS: 

PARAMETER:  CHOSEN-OPENING-WIDTH 

Figure  II.  Rule  Supporting  Opening-Width  Parameter  After  Tuning 

function  which  corresponds  to  opening  as  wide  as  the  cuirent  situation  permits. 

When  the  new  more  uncertainty-tolerant  plan  is  applied,  the  resulting  gripper  finger 
positions  are  as  illustrated  in  Figure  12  and  the  grasp  succeeds.  This  is  only  the  first 
tuning  of  the  opening  width  parameter.  The  system  will  likely  discover  another  po¬ 
tential  problem:  opening  too  wide  is  not  tolerant  of  uncertainties  with  respect  to 
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nearby  objects.  The  process  continues  with  this 
and  other  parameters  to  be  tuned. 

6  Conclusions 

To  construct  manipulation  plans  for  use  in  the 
real  world  requires  one  to  manage  a  set  of  trade¬ 
offs.  One  important  tradeoff  exists  between  the 
tractability  of  generating  the  plans  and  the  extent 
to  which  success  can  be  guaranteed.  This  tradeoff  is  particularly  pronounced  in  deal¬ 
ing  with  uncertainty  where  guaranteed  plans  become  much  more  expensive.  The  in¬ 
cremental  plan  refinement  approach  offers  a  mechanism  for  managing  the  tradeoff. 
Our  approach  makes  use  of  explicit  representations  of  inference  rules  and  operators 
for  the  task  to  generate  and  refine  general  plans  which  include  explicit  applicability 
conditions.  Savings  is  gained  because  uncertainty-tolerance  of  plans  improves 
through  refinement  without  the  need  to  reason  about  uncertainties  during  plan  appli¬ 
cation. 

We  are  currently  pursuing  extensions  to  this  work  in  several  areas.  One  of  these  areas 
involves  developing  an  incremental  technique  for  learning  tradeoffs  which  may  exist 
among  plan  parameters.  For  instance,  in  grasping  an  object  in  a  cluttered  workspace 
a  tradeoff  exists  between  how  wide  the  gripper  can  be  opened  to  sun  ound  an  object 
and  which  faces  were  selected  for  the  grasp  (because  of  the  relationships  of  nearby 
objects).  Another  area  of  work  involves  an  empirical  comparison  of  the  numeric  pro¬ 
babilistic  approach  to  stochastic  actions  [Chrisiiansen90a]  with  an  approach  utiliz¬ 
ing  a  simple  explicit  domain  theory  in  conjunction  with  the  approach  de.scribed  here. 

7  Acknowledgements 

We  would  like  to  thank  Seth  Hutchinson  and  Brian  Falkenhainer  for  their  comments 
on  this  paper.  This  research  was  supported  by  the  Office  of  Naval  Research  under 
grant  ONR  N(X)01 4-86-K-0309. 


Light  line  segments  show 
data  approximation  of  contour 
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Figure  12.  A  Successful  Wide  Grasp 
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